Immersive Interactive Technologies towards a Multi- User 3D Virtual Environment

For many years online text chat such as ICQ [1] has been used as a means of multi-user interaction. As higher bandwidth is available, multipoint videoconferencing systems such as NetMeeting [2] or CUseeMe [3] that allow people from different geographical locations to see and talk to each other are becoming popular. However, these videoconferencing systems lack the sense of immersion because each participant sees other participants in separate windows, and it is often difficult to tell who is talking to whom. Based on user study, Argyle and Dean [4] suggested that during face-to-face communication people vary physical proximity, eye contact and other behaviors to optimize an overall level of intimacy. In addition, Tang and Isaacs [5] found that gaze awareness is important because participants can use the visual cue to determine when another participant is paying attention to them. These studies suggest that a more immersive way of multi-user communication is to connect the users in a 3D virtual environment so that users feel that they are communicating face-to-face. Moving from a text-based chat room environment to a 3D environment creates new challenges in several areas such as computer animation, signal processing and computer vision. In this article, we will introduce immersive interactive technologies used in multi-user 3D virtual environments. We will also survey existing systems, some of which are detailed in other articles in this special issue.